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Abstract 

We present a general framework for systems which are prepared in a non-stationary non- 
equilibrium state in the absence of any perturbation, and which are then further driven through the 
application of a time-dependent perturbation. We distinguish two different situations depending 
on the way the non-equilibrium state is prepared, either it is created by some driving; or it results 
from a relaxation following some initial non-stationary conditions. Our approach is based on a 
recent generalization of the Hatano-Sasa relation for non-stationary probability distributions. 

We also investigate whether a form of second law holds for separate parts of the entropy produc- 
tion, in a way similar to the work of M. Esposito et al., Phys. Rev. Lett., 104:090601 (2010), but 
for a non-stationary reference process instead of a stationary one. We find that although the special 
structure of the theorems derived in this reference is not recovered in the general case, detailed 
fluctuation theorems still hold separately for parts of the entropy production in this case. These de- 
tailed fluctuation theorems lead to interesting generalizations of the second-law of thermodynamics 
off equilibrium. 
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I. INTRODUCTION 



In recent years, a broad number of works summarized under the name of fluctuations 
theorems, have lead to significant progress in our understanding of the second law of ther- 
modynamics [1-3]. A central idea, namely the application of thermodynamics at the level of 
trajectories, has developed into a field of its own, called stochastic thermodynamics [2, 4]. 

In a similar spirit as the Crooks relation [5] , the total entropy production can be expressed 
as the relative entropy between the probability distributions of trajectories associated with 
a forward and backward experiment [6-8]. As a consequence, the entropy production quan- 
tifies the time-symmetry breaking and reversibility which means zero entropy production, 
only occurs when the forward and backward experiments are undistinguishable. While this 
statement for the entropy production encompasses the second law after averaging over many 
trajectories, it also provides additional implications at the trajectory level. 

This particular idea has also played a central role in recent developments of the framework 
of fluctuation relations for systems operating under feedback control [9]. A generalization of 
the Jarzynski relation [10] including the transfer of information due to feedback predicted 
theoretically in this reference has been tested experimentally [11]. With these concepts, it 
is possible to reinterpret Landauer's principle linking information and thermodynamics [12], 
and devise new experiments to test it in a particularly elegant and direct way [13]. Besides 
providing new insights into the deep connection between thermodynamics and information, 
progresses in stochastic thermodynamics make it possible to address optimization problems 
which should be relevant for many applications [14]. 

In previous work, we have analyzed some consequences of a generalized Hatano-Sasa 
relation, in which the stationary distribution entering the original Hatano-Sasa relation [15] 
is replaced by a non-stationary one. In Ref. [16], we have shown that this relation offers 
a way to construct a modified fluctuation-dissipation theorem valid near an arbitrary non- 
equilibrium state; and in [17], we have also derived from it an interesting generalization of the 
second law of thermodynamics for non-stationary states. Such generalizations of the second 
law of thermodynamics and of the fluctuation-dissipation theorem are useful to describe 
the following situations: (i) the system is driven by at least two control parameters, so 
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even when the driving of interest h is constant in time, the probability distribution remains 
non-stationary and (ii) the system undergoes a transient regime due to the choice of initial 
conditions, and before the relaxation of this transient regime is finished, the system is further 
driven. We note that the second situation is typical of systems with a slow relaxation time, 
such as aging systems, in which case the system never reaches a stationary state on any 
reasonable time. Therefore, it seems to us that this framework should be ideally suited to 
analyze aging systems. 



In this paper, we provide a more detailed analysis of the results of Ref. [17], and we 
add some new applications. The first section contains preliminaries on fluctuation theorems. 
We then discuss a particular point concerning the symmetry property that the initial and 
final probability distributions should have for a detailed fluctuation theorem for the total 
entropy production to hold. Although this particular point is known in the literature [3], 
it has been overlooked in many other works in the field despite its importance, and for this 
reason it seems to us that it was useful to provided a refreshing view about this somewhat 
subtle point. In the next section, we discuss extensions of the non-adiabatic and adiabatic 
entropy productions which were introduced in Ref. [18] for the case of a stationary reference 
process. We find that the special structure of the "three theorems" derived in this reference 
is not recovered in the general case of a non-stationary reference process. We interpret this 
as being due to the contribution of a new time-symmetric contribution in the dynamical 
action, which takes a form similar to the traffic introduced in Ref. [19]. We then discuss the 
second-law like inequalities which follow from the integral fluctuation theorems and which 
should be applicable to a broad class of non-equilibrium systems. In the last section, we 
present some illustrative examples of these ideas, using a two state model or a particle in an 
harmonic potential submitted to Langevin dynamics. 
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II. FLUCTUATION THEOREMS FROM GENERAL CONSIDERATIONS OF 
TIME-REVERSAL SYMMETRY 



A. Stochastic modelling and definitions 

We consider a system which is assumed to evolve according to a continuous-time Marko- 
vian dynamics of a pure jump type [20]. Let us introduce the transition rate w t (c, d) for the 
rate to jump from a state c to a state d at time t. The subscript t in Wt(c, d) indicates that 
there are processes which are non-stationary even in the absence of explicit driving. The 
origin of such processes is arbitrary, they can result from an additional underlying driving, 
which is different from explicit driving and does not need to be specified. Note that if the 
system is submitted to an initial quench and a constant driving (explicit or not), the rates 
are time independent but evolution is still non stationary due to the initial quench. At time 
t = 0, an arbitrary explicit driving protocol ht is applied to the system, and we denote by 
Pt{c, [h t ]) the probability to observe the system in the state c at a time t in the presence of 
this driving. The evolution of the system for t > is controlled by the generator , which 
is defined by 



where w t t (d, c) is a transition rate in the presence of the driving [ht]. Then p t (c, [h t ]) is the 
solution of 



The notation pt(c, [ht]) emphasizes that this probability distribution depends functionally on 
the whole protocol history [ht] up to time t. We assume that at t — there is no driving, 
so that po(c, [ho]) = Po(c). We also note that in practice, the driving [ht] may not start 
immediately at t = + but may be turned on only later, after a certain time, called the 
waiting time in the context of aging systems. 

We now introduce a different probability distribution denoted n t (c,h) which represents 
the probability to observe the system in the state c at a time t > in the presence of a 
constant (time independent) driving h. In other words, ir t (c,h) follows from pt(c, [h t ]) by 




(1) 
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freezing the time dependence in the driving [fit]. This distribution, which will play a key role 
in the following, obeys the master equation 

(^(0,^ = ^(0', h)L^c',c). (3) 

From the fact that Tr t (c, h) and p t (c, [h t ]) should coincide for a constant protocol, we deduce 
the initial condition to be 7r (c, ho) = Po(c). 

In Ref. [16], we have shown that one can construct with this distribution the following 
functional 

y[c] = - dTh T d h \mi T (c T ,h T ), (4) 
J o 

which has clear similarities with the functionals introduced by Jarzynksi [10] and Hatano- 
Sasa [15]. We find from the analysis of this paper, that the functional y has the interpretation 
of the driving part in the total entropy production. Using a Feynman-Kac approach, which 
has also played a central role for the Jarzynski relation [21], we have shown in ref. [16] that 
this functional y obeys a generalized Hatano-Sasa relation: 

(exp(-^[c])) = l (5) 

This relation qualifies for a generalization of the Hatano-Sasa relation because the station- 
ary probability distribution p s t(c, h) which enters in the functional Y[c] = — dt h t dh \np st (c t , h t ) 
in the standard Hatano-Sasa relation is now replaced by the more general distribution 
ir t (c,h). From a linear expansion of this generalized Hatano-Sasa, we have obtained modi- 
fied fluctuation-dissipation theorems valid near an arbitrary non-equilibrium state [16, 22]. 
In the next sections, we derive this generalized Hatano-Sasa relation in a different way and 
we investigate other consequences not contained in such a linear expansion. 

B. Path probability distributions and action functional 

Let us consider a trajectory [c] = (c , c±, c^; 7~i, .., t^) where the q are the states which 
are visited by the system and are the jumping times to go from q_i to q. The total time- 
range of the trajectory is [0..T]. We denote V[c] the probability to observe such a trajectory 
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[c], also called path probability below : 



V[c] = po(co) 



N 



Jexp 



.3=1 



drXr T (cj-i) 1 <>■:/(<- : .cj) 



exp 



dr\^(c N 



(6) 



where X^ T (d) = J2 c ^c' w r ( c '> c ) represents the escape rate to leave the state d, and po(co) 
Po(co, ho) represents the probability distribution of the initial condition. 

In the following, we consider several ratios of path probabilities of the form: 



AA[c] 



V[c*] 



(7) 



where the tilde symbol (~) corresponds to a transformation of the original dynamics into 
a new dynamics. This new dynamics is defined by its own initial condition and by the 
transformed transition rates denoted by w. The (*) denotes a different transformation which 
acts on the trajectory itself. The transformed trajectory [c*] = (cq, cj, .., c* N ; rj", .., r^) results 
from the application of an involution on the trajectory [c] which we assume to be either the 
identity ([c*] = [c]) or the time-reversal symmetry acting on the trajectories ([c*] = [c] = 
(c^, cjv-i, ••, Co; T — tn, ■■, T — n)). In other words, we have 



CN- 



if * is identity, 

if * is time reversal, 



T; 



Ti 



TN-i+1 



if * is identity, 

if * is time reversal, 



with the convention that Tq and r^ +1 are respectively and T when * is identity and are 
respectively T and when * is the time reversal symmetry. Substituting the trajectory [c*] 
in replacement of [c], and the rates of the modified dynamics w instead of the original rates 
w in Eq. 6, one obtains directly for the transformed path probability : 

N 

PYTt l / 3 fW\ h -( L . 



P[c* 



Po{c ) 




drA>(c* ) 



[C j -i,C jj 



3-1 



exp 



JV+l 



drA 



■'N) 



(9) 

where A^(c') = Ylc^d w^. T {c', c) represents the escape rate to leave the state d in the dy- 
namics modified via the operation tilde. From this we see that A^4[c] can be written as 



AA[c] = hx^ 



Po{c ) 



Po(c* ) 



N 



* ^ nil 

^(^-A^J + ^ln^ 



[Cj-i, Cj 



i=i 



(c*-vc*) 



(10) 



with c t = Cj if t G [rj,Tj +1 [ and A t ' = A^ 4 (or A t * = A t *) if the involution * is the time 
reversal (or respectively if * is identity). Thus, A^4[c] has three different contributions: the 
first term is a boundary term which only depends on the initial or final configurations, the 
last term is a bulk term, which depends on the whole trajectory. The second term is related 
to the notion of traffic [23], which represents the integral of the escape rate At evaluated at 
the actual configuration c t of the system at time t. In view of this property, the second term 
in Eq. 10 represents a difference of traffic between the original dynamics (which corresponds 
to V) and the transformed dynamics (which corresponds to V). 

C. Protocol-reversal symmetry and the probability distributions of the initial and 
final points 

Fluctuations theorems can be derived from considerations of symmetry for an arbitrary 
observable and arbitrary initial and final probability distributions [24]. These choices of 
observables, of initial and final probability distributions determine precisely which fluctuation 
theorem holds. In this construction, we emphasize that the fluctuation theorem takes a strong 
form if the initial and final probability distributions are related by a reversal of protocol and 
a weaker form if not [3]. Then, two cases must be considered, either the initial and final 
path probabilities are not related by the reversal of the protocol and the transformation (~) 
is not an involution; or such a symmetry exists and the transformation is an involution. In 
the following, we discuss both cases separately : 

• Let us first assume that ~ is not an involution. This occurs for instance when the 
initial condition does not satisfy po(c) = Po{c). Following Ref. [18], we consider 

P(AA[c) = AA) = Y^5(AA- AA[c])V[c], (11) 

[c] 

= exp (AA) 6 ( AA ~ A.A[c])P[c*], (12) 

[c] 

= exp (AA) P(AA[c*} = AA), (13) 
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with 

P(AA[c*] = AA) = J2 6 ( AA ~ A Ac*])V[c]. (14) 

[c] 

With words, P(A.A[c*] = AA) corresponds to the probability to have on a given tra- 
jectory [c*], A^4[c*] equal to AA in the tilde experiment/dynamics. When comparing 
with the expression of P(A*4.[c] = AA), it appears that the same function A A is 
evaluated on different trajectories ([c] or [c*]), which are themselves generated by dif- 
ferent dynamics (the original dynamics or the tilde dynamics). Thus, the probability 
P(A.A[c*] = A.A) cannot be defined in itself, i.e. without reference to the quantity 
AA introduced in the original dynamics [3]. For this reason, we regard the detailed 
fluctuation theorem (DFT) of Eq. 13 has a weak version of the theorem. 

• Let us then assume that the operation (~) is an involution acting on the path prob- 
abilities, V = V. This implies that the distribution of initial condition satisfies the 
condition po(c) = po(c) and that the transition rates satisfy w t *(c, d) = w$*(c, d). 
From these two conditions or equivalently directly from the definition Eq. 7, it follows 
that: 

AA[c] = -AA[c*}, (15) 

where A^4[c] = ln7 3 [c]/'P[c*]. With this symmetry property, the fluctuation relation 
for A.4. now takes the form 

P(AA[c) = AA) = exp (AA) J2 6 ( AA + &A[c*\)V[c% (16) 

[c] 

= exp (AA) P(AA[c] = -AA), (17) 

with 

P(AA[c) = -AA) = ^2S(AA + AA[c])P[c], (18) 

[c] 

which corresponds with words to the probability to have on a given trajectory [c], 
A^4[c] equal to — AA in the tilde experiment/dynamics. As expected one can obtain 
directly Eq. 18 from Eq. 14 using Eq. 15. The main difference with the previous 
case where tilde was not an involution is that now, it is not the same function which 
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must be evaluated in the two experiments/dynamics characterized by P (resp. P); 
rather it is two different functions, namely A^4[c] and A^4[c]) but they are related 
because they represent the same physical quantity which takes different form on each 
experiment /dynamics. This is similar to the Crooks relation [5, 25], where the same 
physical concept, namely the dissipated work, must be evaluated in the direct and tilde 
experiment /dynamics (although the precise function which represents this physical 
concept takes a different form in both cases). The main point is that here unlike in the 
previous case, the function which must be evaluated is linked to the process (direct or 
reversed) under consideration. We thus regard Eq. 17 as a strong form of the detailed 
fluctuation theorem. 

As a particular important illustration of this point, we discuss below the detailed fluctu- 
ation theorem satisfied by the entropy production. To do so, we consider both involutions 
introduced above, namely (*) and (~), to represent a reversal symmetry, respectively the 
reversal of trajectories and of protocol, which we both denote with a bar (— ). We recall 
that the effect of this symmetry must be considered separately on the trajectories and on 
the dynamics. The rates which control the dynamics are transformed as 

w^(c,c>) = w!?_-;(c,c'), (19) 

since the order in the visited configurations is not affected by the transformation while the 
time dependance of the driving is. Therefore, one can think of this transformation as basically 
a time-reversal of all protocols (the driving [ht] and the other protocols represented by the 
extra subscript in the rates). Note also that Eq. 19 represents a transformation for the rates 
which is always an involution unlike the full reversal of the path probabilities which may or 
may not be an involution depending on the initial conditions. This point is very relevant 
for the existence of a detailed fluctuation theorem for the entropy production. Indeed, in 
order to identify A as entropy production, the initial probability distribution of the reversed 
process must correspond to the final probability distribution reached by the direct process 
[24]. In other words, one must choose Po(co) = Pt{ct) where pt is the solution of the Master 
equation/Fokker Planck equation at time T. From Eq. 10, due to the vanishing of the second 
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term, one obtains the familiar result [6, 24]: 

AS M lc}=^ = AS + ± h "» (20) 

7 [q i=i "'v. '(':,•':, :) 

where the first term AS = lnpo(co) — In Pt{ct) represents the change in system stochastic 

entropy while the second term represents the change in reservoir entropy A5 r [c] along the 

specified trajectory [c]. 

In view of the discussion above, it is not obvious that the transformation of the full path 

probability denoted (— ) as defined above is an involution in the particular case of the entropy 

production. Only when additional assumptions are made, namely that the initial and final 

probability distributions are related by a reversal of the protocol, can this transformation 

be an involution. Incidentally, this condition means equivalently that the system stochastic 

entropy AS* is antisymmetric with respect to a reversal of the protocol. When this is the 

case, one obtains from Eq. 17, the following detailed fluctuation relation 

PjAStotW = AS**) 
P(AS tot [c\ = -AStot) 
which many authors as [18] have denoted using a simplified notation 

l »^r AS - (22) 

Note that this relation takes the form of the Evans and Searles theorem [26] in the following 
particular cases: (i) for non-equilibrium stationary processes and (ii) for processes generated 
by time-symmetric driving protocols with the additional condition that the initial and final 
conditions are related by the reversal of the protocol. 

When po( c o) an d Po(co) are not related by a protocol reversal, the detailed fluctuation 
theorem for the entropy production only holds in its weak form namely Eq. 13. As explained 
above, this means that the quantity which enters this detailed fluctuation theorem for the 
reversed process is not the entropy production of that process. 

D. Dual dynamics and difference of traffic 

We now introduce a new transformation, called a duality transformation, which acts 
specifically on the dynamics of the process. In the following, this transformation is denoted 
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with a hat (A). In analogy with the way this dual transformation has been introduced in 
the stationary case [15, 18], we define the dual dynamics from the original dynamics by 
substituting the original rates w^(c,c') by : 

w!(c,<<) = W W>fl?' h \ (23) 

7T T (C, h) 

From this definition, it is not obvious that the duality transformation is an involution al- 
though it is indeed the case as we show in appendix A. The basic idea is that this transforma- 
tion essentially reverses the probability currents defined with respect to vr t (c, h), and because 
of this, it follows that this transformation is an involution. The proof also confirms that the 
dynamics constructed from the dual rates is Markovian. The generator of the dynamics still 
verify J^ c , I^*(c, d) = 0, where we have defined as in Eq. 1 substituting the rates w^* by 
the rates w^. The normalisation of the probability distribution is thus conserved in time. 

An important property of the probability distribution ir t (c, h) justifying its use to define 
the duality transform, is that it is related to the difference between the escape rates of the 
direct and dual dynamics, because : 

^r(c) - X h r(0) = C ') - C')) , (24) 

= J2 (K\c, h)w T (c', c)n T (c', h) - w h T (c, c')) , (25) 
= Y,K 1 (c,h)w T (c',c)ir T (c\h) -^^(c,c"), (26) 

d c" 

= ^r\c, h) lw T ( C ', C) - 5 dc Wr(c', c") J TT T (c' , h) , (27) 

d V c" / 

= ir-\c,h) (d T 7i T ) (c,h) = (9 r lnvr r ) (c,h), (28) 

where in the last step we used the evolution equation Eq. 3. We define the difference of 
traffic between the direct and dual dynamics as 

AT[c] = j\r (\ h /(c T ) - A^(cv)) = - £ dr(d T \nir T ) {c T ,h T ). (29) 

From this last expression, we note that the difference of traffic vanishes when the reference 
probability n t is stationary; and that this quantity is antisymmetric under the duality trans- 
formation AT[c] = — AT[c] but symmetric under the combined action of the reversal of the 
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trajectories and of the full protocol (which we regard as the total-reversal symmetry): 

AT [c] = £dr (\>(c r ) - fyicrj) , (30) 

= J T dr (Aj T _7(c r _ T ) - A^_7(c T _ T )) , (31) 
= AT[c], (32) 

In the end, combining the total-reversal symmetry and the duality transform together, we 
obtain that AT[c] = -AT[c]. 

E. Adiabatic and non-adiabatic entropy productions 

A system can fall into a non-equilibrium state by two mechanisms: (i) either detailed 
balance can be broken due for instance to boundary conditions or (ii) the system can be 
driven. Building on a number of works on steady-state thermodynamics [15, 27-29], it was 
shown in Ref. [18] that that these two different ways to put a system in a non-equilibrium 
state correspond to two separate contributions in the entropy production, called adiabatic 
for case (i) and non-adiabatic for case (ii). Note that this term "adiabatic" does not refer 
to the absence of heat exchange but rather to the fact that this contribution is the only 
one which remains in the adiabatic limit of very slow driving. In this reference, it was 
shown that surprisingly both terms can be expressed as logratios of probabilities, which 
implies that both quantities satisfy separately a detailed fluctuation theorem (DFT). This 
property is surprising because it is not expected to hold for a general splitting of the entropy 
production. Indeed it does not hold for instance for the splitting of the entropy production 
into system entropy and reservoir entropy [24]. As a further consequence of these DFTs, 
both the adiabatic part and the non-adiabatic are positive on average, which means that the 
second law can be split into these two components. 

In this section, we generalize the notions of adiabatic and non-adiabatic entropy produc- 
tions defined as in [18, 30] for the stationary case, by replacing the stationary distribution 
by the distribution ir t (c, h) defined in Eq. 3. We obtain the following splitting 

Pt[C T , [hr]) TTrjiCj^hr.) 
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and 

x— v WrJ 3 (c,-_i, C,-)tT t .(c,-_i, h T .) , 

AS a [c] = J2 ln V 3 3 3 3 3 , (34) 
j=i «•:/(<[,.<;, i)r; ; ,(r ; .// ; ) 

so that we still have AS' to t[c] = AS^c] + AS a [c]. 

We note that the adiabatic entropy production verify AS a [c] = — A5 a [c] which means 
that it is anti-symmetric with respect to the combination of the protocol-reversal and the 
time-reversal of the trajectories, transformation that we call the total-reversal. On the 
other side, the non-adiabatic entropy production is anti-symmetric under the total-reversal, 
i.e. A5 na [c] = —AS na [c], when the total entropy is (provided the appropriate condition 
on the initial and final states holds as explained in the previous section). We can also 
define an excess entropy production AS ex such that AS^c] = AS + AS^fc] and ASJc] = 
AS r [c] - AS ex [c\. 

It is natural to ask at this point whether AS na and AS a separately satisfy a DFT. These 
quantities are not a priori of the form of Eq. 7, except for the particular case studied in 
[18] where the reference is stationary, so AS na and AS a should thus not in general satisfy 
separately a DFT. We thus loose, with the definition of Eqs. 33-34, the positivity of the 
mean adiabatic and non adiabatic entropy productions. Despite this, we will see that their 
joint probability distribution still satisfies a DFT as explained in section III A. 

F. Non-adiabatic and adiabatic action functionals 

In this section, we show that the difference of traffic AT introduced above is a key 
observable which can be used to construct quantities which satisfy a DFT. We start from 
the two possible decompositions of the entropy production as 

(A) AS tot [c] = In 3^ + In ^fj or (B) AS tot [c) = In 9^ + In ffl. (35) 
V ; 1 J p[c] V[c\ K ' tot[ J V[c] V[c\ 1 ; 

We first remark that, contrary to the case of [18] where the stationary probability distribution 
is chosen as a reference, the two decompositions are not equivalent. This is due to the fact 
that the two terms in the decomposition are not anti-symmetric under total-reversal any 

13 



more, since they contain a non zero difference of traffic term, defined above: 

V\c\ P[c] r f[c\ 

Case A - We first focus on the first term in the r.h.s. of Eq. 35A, which we call the 
non-adiabatic action AA M [c], Using Eq. 10 with the choice V = V for the path probabilities 
and c* = c for the trajectories, we obtain 

Given the initial condition po(co) = Pt(ct) for the dual reversed experiment, the first term 
in this equation corresponds to what we have denoted before AS" = lnpo(co) — ^Pt{ct)- 
Using Eq. 23 and Eq. 33, we obtain 



AA na [c] = AS + [ dr (d T \mr T ) (c T ,h T ) + Y]ln 
Jo j^X 



^Tji'-j-l': ) 

71 Ti ( c i-lj h Tj/ 



= AS na [c] - AT[c], (37) 

which corresponds to a decomposition into two terms, where the first term, AS" na [c], is anti- 
symmetric and the second term, AT[c] symmetric under total-reversal. Alternatively, we 
can also write the same quantity as 

fT 



AA na [c]=AS+ [ dr(d T ln7r T )(c T ,h T ) + Vln y 3 ' 

Jo ^ICj-i, 

= AS — Atp + / drd T (ip T (c T ,h T )) + / dr (9 T ln7r r ) (c r , h 7 
Jo Jo 



(31 



+ Vln ^tSL 
7r T .( Cj -_i,/i r ,) 

= A5 6 + y[c], (39) 

where AS 1 ;, = AS — A^ is a boundary term, with Aip = — ln7Pr(cT, hr) + hi7r (co, /io)- 
Therefore, since po( c o) = ^(Qb ^o) by construction, 

AS t = ln^iM. (40) 
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As a result, the average of ASb, is related to the Kullback-Leibler divergence between the 
distributions ttt and pt- Physically, this quantity can be viewed as a measure of the lag 
between the two distributions, in the same way that one can look at the dissipated work 
as a measure of the lag between the actual distribution at time t and the corresponding 
equilibrium distribution with the control parameter at the same value [31]. When there is no 
lag, either because px has relaxed towards ttt, or because the initial probability distribution 
of the reversed protocol, namely pt(ct), is chosen to be ttt(ct, hr), then the two distributions 
are identical and ASb vanishes. In this case, AA na [c] = y[c], which satisfies the symmetry 
condition y[c] = —y[c]. Therefore, from Eq. 7 and Eq. 17, this quantity satisfies a DFT: 

ln pm = y) =y (41) 

p(3>H = -y) 

If we don't have a vanishing boundary term, then unfortunately only the weak fluctuation 
theorem of Eq. 13 is verified 

P(AA[c] = AA,„) 
We now look at the second term in Eq. 35A, namely 

AA a [c] = AS t ot[c) - AA na [c] = In ffl. (43) 

V[c] 

We can rewrite Eq. 43 as 

j=l «•/• .. ('>'•./ l) 

dr (d r In vr T ) (c T , h T ) + In ^^-i.^K^-i,^) ^ ^ 

j=1 Wr- 3 (Cj, Cj^i)^. (Cj, h : ) 

= A5 tt [c] + Ar[c], (46) 

which corresponds again to a decomposition where the first term, AS a [c], is anti-symmetric 
and the second term, AT[c] symmetric under total-reversal. As a self-consistent check, we 
see that the difference of traffic AT, in AA a exactly compensates an opposite contribution 
in AA na so that 

ASM = AA a + AA na = AS na + AS a . (47) 
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One important point is to realize that AA a is not of the form of Eq. 7 because it involves 
a modified path probability both at the numerator and the denominator in its definition. 
Therefore a detailed fluctuation relation of the form of Eq. 41 is not verified for this quantity. 



Case B - One can however find another DFT, by starting from the splitting of the entropy 
production of Eq. 35B. We define the first term on the r.h.s. by 

AB a [c] = In ?j4 = -AA a [c] = -AT[c] + AS a [c\. (48) 
V[c\ 

and we also introduce the quantity 

AB na [c] = In ffi = AA na [c] = AT[c] + AS na [c] . (49) 
V[c\ 

Here AB a plays a role similar to AA na since it too has the required form to satisfy a detailed 
FT, which is 

, P(AB a \c\ = AB a ) A , . 

In , v s aU ^- = AB a . 50 

P(A5 a [c] = -AB a ) 

As before for AA a , the remaining part in the total entropy, namely AB na , does not satisfy 
a detailed FT. 



G. Some limiting cases of interest 

In this section, we discuss some of the limiting cases for which the detailed fluctuation 
relations obtained above simplify. Let us assume that the driving starts at time > and 
ends at time tdf < T for a total duration td = tdf — tdi- 

• When ir t (c,h) relaxes very quickly to the stationary distribution (on a time scale r s t 
such that r st T and r st td), one recovers from Eq. 33 and Eq. 34 the usual 
definitions of the non-adiabatic and adiabatic parts of the entropy production. In this 
case AT = 0, and as a result Eq. 41 and Eq. 50 become the usual DFTs satisfied by 
the non-adiabatic and adiabatic entropies respectively [18]. 

• In the limit of slow driving h t ~ 0, which can happen without having 7r t (c, h) relaxed 
to a stationary distribution, the driving part of the entropy production, y[c], vanishes. 

16 



Furthermore, the boundary term AS& also vanishes, because in this case pt(c, [ht]) 
relaxes to ir t (c,h) since [ht] — > h. In this limit AA na = 0, which justifies a posteriori 
the name non adiabatic action for AA na . The vanishing of AA na has two further 
consequences, the first one is that Eq. 36 implies V[c] = V[c], in other words, the 
duality and total-reversal compensate each other exactly. Another consequence is that 
AA a = AB a = AStot, which implies that AT = although 7it(c, h) is time-dependent. 
Furthermore, the fluctuation theorem of entropy production namely, Eq. 21 coincides 
with that for AB a , namely Eq. 50. 

H. Modified second law for transition between non-stationary states 

The observables introduced in section II F verify an integral Fluctuation Theorem and 
therefore are submitted to second law like inequalities, which are valid for an arbitrary 
non-equilibrium reference process. This results from the positivity of the Kullback-Leibler 
divergence between the path probabilities V[c] and V[c]\ 

D{V[c]\\V[c\) = 5>[c]ln?M = {AAna) > o, (51) 

and between the distributions V[c] and V[c] 

D{V[c]\\V[c\) = E^H ln |r| = < Afi »> > (52) 

[c] ' L C J 

In view of Eqs. 37, 48 and 47 , this implies 

(AS na ) > (AT) . (53) 

Furthermore, one also has (AS a ) > (AT) and (AS to t) > 0, which taken together imply 
(AStot) > max(2(AT), 0). However, all these inequalities are less binding than Eq. 53, 
because the adiabatic entropy production and the total entropy production are generally 
increasing function of time whereas the inequality Eq. 53 becomes an equality in the long 
time limit as explained below. We note furthermore that : 

(i) Although we have shown that (AA na ) > and (AB a ) > 0, the corresponding conjugate 
quantities of AA na and AB a with respect to the total entropy production, namely AA a and 
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AB na , do not have likewise a positive mean in general. That this should be the case can be 
understood from the consideration of a particular case, namely the case where the initial non- 
equilibrium condition has been prepared by the application of a protocol, which is exactly 
compensated by the second protocol (the perturbation) denoted [h t ] in this paper. In this 
case, the system is in equilibrium at all times in the presence of the perturbation. Since 
the rates satisfy the detailed balance condition, one can check explicitly that this implies 
AA a = —AA na as expected since the system is in equilibrium and AStot = 0. It follows from 
this that in this case {AA a ) < and (AB na ) < 0; so in this case AA a and AB na do not have 
positive means. 

(ii) The first inequality in Eq. 53 can be written 



In other words, the average of the functional y is bounded by — AS& = D(px\ \7Tt) which is 
a measure of the lag between the distributions pt and tit- As noted before, a similar result 
holds for the dissipated work for the case of an initial equilibrium probability distribution 
[31]. Recalling the definition of the excess entropy, AS na [c] = AS + AS ex [c], one can also 
express this inequality as a Clausius type inequality of the form 



which contains as particular cases, the Clausius form of the second law for transitions between 
equilibrium states and a modified version of the second law for transitions between NESS 



(iii) As noted above, the equality in the first inequality of Eq. 53 holds in the adiabatic 
limit for infinitely slow driving. In this limit the r.h.s. of Eq. 54 is zero because there is no 
lag between the distribution pt and n?- The fact that the inequality can be saturated is 
essential for identifying Eq. 55 as a generalization of the second law of thermodynamics. 



(y) > D(p T \\7r T ) > o. 



(54) 



(AS) > - (AS ex ) + (AT) 



(55) 



[15]. 
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III. FLUCTUATION THEOREMS FROM CONSIDERATION OF GENERATING 
FUNCTIONS 



Generating functions provide an alternate way to understand fluctuation relations without 
considering trajectories explicitly. Let us introduce the generating functions of (AT, AS a ) 
and of (AT, AS na ), namely 

#(c )T ,6) = (5(c-c T )e^ Ar ^ As ^), (56) 
g % a \c, 7 , e) = (5(c - CT ) e -^T[c]-eAs na [c]^ (5?) 

These quantities satisfy deformed master equations of the form : 

^ (a) (c, 7 ,6) = J> (a) (c',7,e) (^!r^:) #(<!,c) + 1 (d t \nn t )(c,h t )g i t a \c, 1 ,e) J 

** M fe7, e ) = E^.7.«)(^g)\V,c) (58) 

+ [y(d t hi7r t )(c, ht) + ed t \np t (c)} g[ na \c, 7 , e). (59) 

We can check that in the special case where 7 = — 1 and e = 1 the solutions are 

g£\c, -1, 1) = p T (c) = (5(c - c T )e- AB ^) , (60) 
g ( ™\c, -1, 1) = p T (c) = (6{c - c T )e- AA ^) (61) 

where pt(c) is the solution of the master equation with generator as defined in appendix 
A. Note that Eq 61 can be transformed to remove the boundary term in Av4 na [c] in the 
following way 

PT (c) = (5(c - c T )e~ ASb ~ y[c] ) , (62) 
= J2vic\c o]M c )5(c-c T ) { Mco)Mc ^ hT) )e y[ \ (63) 

= J ^Y.ncW-c T )e-y^\ (64) 

so that we finally get the result for the generating function of y[c] already obtained in [16] : 

n T (c,hT) = (S(c-or)e- y ®). (65) 
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Through integration over c, we immediately obtain from Eq. 62, the integrated fluctuation 
theorem 

(e- AA ™ [c] ) = 1, (66) 

given that AA na = ASj, + y. This integrated fluctuation theorem also follows directly from 
Eq. 42. Similarly, by integrating over c in Eq. 65, we have 

( e - y W) = 1, (67) 

which is nothing but the generalized Hatano-Sasa relation given in Eq. 5. Using the Jensen 
inequality, we recover from these relations, the second law like inequalities of the previous 
section. 



A. Fluctuation theorems for joint probability distributions 

As shown in [32, 33], it is possible to derive fluctuation theorems for joint probability 
distributions of variables which form parts of the total entropy production even when each 
variable does not satisfy separately a fluctuation theorem. This approach has many advan- 
tages as it offers a unifying principle to recover many fluctuation theorems. It is straight- 
forward to apply this idea to the general case of an observable AA of the form of Eq. 7. 
We assume that this observable can be decomposed into a sum of m observables which are 
anti-symmetric with respect to the combined action of the tilde and of the star involutions: 
AA = YT=\ A "^' with A ^A C *] = ~AAi[c] for i = l..m. We now have 

m 

P(AAi[c] = AA 1 ,..,AA m [c] = AA m ) = J2H s ( A ^i ~ A A[c])V[c], (68) 

[c] i=l 
m 

= E II 6 ( AA * + A Mc*}) exp (AA) V[c% 

[c*] i=l 

= e^P^AAM = -AAi, .., AAm[c) = -AA m ). 

where the probability P is defined by 

n 

P(AA 1 [c] = AA 1 ,..,AA m [c] = AAm) = P[c] JJ «J(AA - M[c]). 

[c] i=l 
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Note that if the observables AAi do not satisfy the antisymmetry property with respect to 
the combined action of the tilde and of the star involutions, we still have a weak form of the 
fluctuation theorem similar to Eq. 14. 

In the particular case of the decomposition of AS to t into AS na and AS a that are anti- 
symmetric by total reversal, we have 

P(AS a [c] = AS a ,AS na [c] = AS na ) 
P(AS a [c] = -AS a ,AS na [c] = -AS na ) ~ Aba + A ^ (6J) 

We can also apply the same idea on the decomposition AA na = AS na — AT obtained in 
Eq. 37. Since, AS na and AT are both antisymmetric under the combination of the duality 
and the total- reversal (AS na [c] = —AS na [c] and AT[c] = — AT[c]), we have 

h P(AT[cl = Ar,A S „„[^A S „ a ) = ^ _ AT 
P(AT[c] = -AT, ASJc] = —ASna) 

In the same way, there is a DFT associated with the decomposition AB a = AS a — AT be- 
cause both AS a and AT are also antisymmetric under the duality transformation (AS' a [c] = 
-AS'afc] and AT[c] = — AT[c]). Thus, we have 

^P(AT[c] = AT, A^ajc] = AS a ) = Ar 
P(AT[c] = -Ar,AS a [c] = -AS a ) 



IV. ILLUSTRATIVE EXAMPLES 

In the following, we illustrate using simple analytical models, the fluctuation relations and 
the modified second law discussed above. There are two main ways to create non-stationary 
reference distributions. Either these non- stationary distributions can be created due to the 
choice of initial conditions or due to a driving force. We illustrate both cases with a driven 
two states model, and we focus particularly on the case of sinusoidal driving. Besides this 
two state model, we also study a model for a particle in an harmonic potential and obeying 
Langevin dynamics. 

21 



A. Two states model dynamics 



1. Non-stationarity from relaxation due to the initial conditions 

We consider a two states model described by the following master equation: 

d tPt {a) = -w ht {a,b) Pt {a) + w ht (b,a)p t (b), (72) 

where the jump rate from state a to state b is denoted w ht (a, b) in the presence of the driving 
h t , and w(a, b) in the absence of this driving. We arbitrarily parametrize the rates as 

w ht (a, b) = w{a, b)e~ ht/2 and w ht {b, a) = w{b, a)e ht/2 , (73) 

where h t can be thought of as a force which introduces a biais in the transitions rates. Note 
also that these rates depend on time only through h t . In order to create a non-stationary 
distribution, we choose the initial probability distribution to be in state b, Po(b), at an 
arbitrary value different from the steady state value (p s t{a) = w(a,b)/(w(a,b) + w(b,a))). 
As a result, even in the absence of driving, the system will relax in time. 

For simplicity, we assume that the driving follows a half sinusoidal protocol depicted in 
the inset (i) of figure 1, which implies that both the driving and the transition rates are 
symmetric with respect to time. In inset (ii) of figure 1, we show the relaxation of ir t (b, h) 
towards the equilibrium distribution at a given value of h for two choices of the unperturbed 
rates. One relaxation is faster than the other one because the unperturbed rates are chosen 
to be larger. 

In order to illustrate the DFT of Eq. 41, we have evaluated numerically the functions 
TTt(c,h) for different constant force protocols h with a kinetic Monte Carlo algorithm [34]. 
Using this data, we have generated an ensemble C of trajectories with the dual reversed 
dynamics. We have also built separately an ensemble C of trajectories corresponding to 
the original dynamics. Then, we have measured the probability of y[c] with [c] E C and 
the probability of [Vt[c] = — ^[c] with [c] £ C counting the number of times that the value 
of these functionals were in a given range [y,y + 8y]. In figure 1, we verify the detailed 
fluctuation relation for 3^ for the slow and the fast protocol of inset (i). In both cases, the 
initial condition of the dual reversed experiment was chosen to be Pt{c) = ttt(c, hr) which 
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means that by construction ASb = and AA na [c] = y[c]. We find that the probability 
distributions obtained from these simulations follow the expected symmetry. There is one 
practical difficulty in these simulations, which is also frequently encountered with other 
numerical tests of fluctuation theorems. One needs to find conditions such that the system 
is not too far from equilibrium to get a good overlap between P(y) and P(—y), and at the 
same time sufficiently out of equilibrium so that the probability distributions are distinct 
despite numerical errors. 

2. Non-stationarity from periodic driving 

To illustrate the inequalities generalizing the second-law for transitions between non sta- 
tionary states obtained in Eq. 53, we use again the same two states model but now with 
a different protocol. The shape of the protocols for the driving protocol ht and the relax- 
ation of p t towards 7i t is shown in figure 4: the protocol oscillates around an average value 
h% vg which evolves in time following a piecewise protocol of duration td = tdf — tdi- This 
average of the protocol h™ 9 represents the real driving which induces a transition from one 
non stationary state to another one, while the oscillations around the average create these 
non-stationary states. As before, we have used kinetic Monte Carlo simulations to measure 
the functions TT t (a,h av9 ) for different values of h avg . We have then carried out simulations 
with the time-dependent driving to obtain the quantities (y), (AT) and (AS na ) at fixed 
final time T for different values of the duration of the driving td- As expected, we observe on 
figure 2 that (AS na ) > (AT). When we calculate (ASb) at the final time T, we find a value 
close to zero irrespective of the duration of the protocol td because the system has either be 
driven so slowly that pt(c, [h]) has relaxed to ir t (c, h t ) already at the end of the protocol at 
tdf or, the system has relaxed afterwards between the times tdf and T. This is compatible 
with (y) > — (ASb), but in fact, since (y) does not change between the time t d f and T, 
one can obtain a closer bound for (y) by evaluating (ASb) at the final time of the driving 
tdf instead of T as shown in figure 2. For this reason, in figure 2, we show (y), (AS na ) and 
(AT) evaluated between the time tdi and time T whereas (ASb) is evaluated at time tdf- 

In this figure, we also show that the way (y) approaches the adiabatic limit for large td 
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is through a scaling law in l/t^. In fact, this is precisely the scaling found in this limit for 
the dissipated work for a process starting in equilibrium as function of td- This dependence 
has been first theoretically predicted in [35], and recently confirmed in an experiment aimed 
at testing experimentally the Landauer principle [13]. 

B. Overdamped Langevin dynamics 

In the previous section, we have used the same control parameter to create the non- 
stationary state and to induce a transition between the initial and the final non stationary 
states. On the contrary, in this last section, we consider a particle obeying an overdamped 
Langevin dynamics in an harmonic potential with two different driving forces, a time- 
dependent spring constant kt which oscillates and create a non-stationary periodic state, 
and a piecewise non conservative time dependent force h t which acts as driving inducing 
transitions. The position x t of the particle is given by the following stochastic differential 
equation 

7i t = -hx t + h t + r)t V^l/P, (74) 

with 7 the friction coefficient, (3 the inverse temperature and rjt a Gaussian white noise of 
mean zero and variance unity. In this case, x t is a gaussian process, which means that the 
probability distributions Pt(x, [h t ]) and n t (x, h) are known from the variance and the average 
value of the position [16]. From these quantities, we obtain y directly through Eq. 4 and the 
boundary term ASbitdf) from \im tdf (x tdf , h tdf ) — \np tdf (xt df , [h]). As in the other example, we 
confirm that (y) > — (ASb) for all values of the duration of the driving td- 

In a recent experiment, the heat fluctuations of a brownian particle have been measured 
in an aging gel, created by a sudden temperature quench [36]. This aging gel plays the 
role of a non-equilibrium bath for the probe particle. With the same experimental setup, 
the deviation from the fluctuation-theorem has been measured by evaluating separately the 
correlations and the response function [37]. A complete discussion of these interesting results 
is out of place here, but instead we show that the detailed fluctuation for the heat exchange 
obtained in this reference follows from the framework developed in previous sections. The 
dynamics followed by the probe particule in the experiment is similar to that described by 
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Eq. 74 but differs from it in that in the experiment, there is no driving force and the spring 
constant is not time dependent. We can adapt the formalism developed in section II B to 
the experimental situation by choosing a similar logratio of probabilities as in Eq. 7 with the 
tilde operation taken to be the identity, and the star to represent time-reversal. We therefore 
consider the quantity 

Mx]=J~||. (T5) 
Since the quench, which occurs at time 0, is very fast and there is no subsequent driving 
in the experiment, the dynamics occurring at time t > is described by time-independent 
rates denoted simply w(c,c'). If we consider now a path probability ratio with trajectories 
starting at time t > and finishing at time T, we obtain from Eq. 10, that 

Ap[x] = In — - — - + > In — ^ J —, (76) 

where the index j corresponds to time t. Since tilde was chosen to be the identity, it is 
obvious that the corresponding transformation of the full path probability is an involution. 
It follows from section II B that in this case 

P(Ap[x] = -Ap) H v ' 

Now, the second term in the r.h.s. of Eq. 76 corresponds to what is called medium entropy 
AS m . The temperature of the medium surrounding the probe particle equilibrates very fast 
(unlike the degrees of freedom associated with the polymers which constitute the gel), so that 
we can consider that AS m = —/3q, where /3 = 1/T, and T is the equilibrium temperature of 
the surrounding medium, with q is the heat exchanged by the particle and the medium. Since 
there is no work, this heat is simply the variation of internal energy, so q = k(xf +T — xf)/2. 
Furthermore, since the quench is fast and the system was prepared in an equilibrium state 
before the quench with a gaussian distribution, the distribution of the initial condition at 
time t is still a gaussian of variance denoted cr^(t) in Ref. [36]. At time t+T, it is assumed that 
the system is equilibrated so that ka^.(t + T) = kgT '. In view of this, we obtain from Eq. 77, 
the fluctuation relation satisfied by the heat q obtained in this reference with Ap = — A/3q, 
and 

(78) 



k 



a x (t + T) 2 a x (ty 
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which is interpreted as an effective temperature imbalance [36]. This property however only 
holds for the case of linear Langevin dynamics with a time- independent spring constant. 

We thus see on this example that the detailed fluctuation relation satisfied by the heat 
exchange in Eq. 77 follows from general considerations of a logratio of probabilities of the 
form of Eq. 75. That this should be the case was also apparent in the derivation of a related 
fluctuation theorem satisfied by the heat exchange between a system and two thermostats 
[38]. 

V. MORE COMPLEX SYSTEMS 

When using the theoretical framework developed in this paper for complex systems - 
such as aging systems -, one will encounter the difficulty already present in the standard 
Hatano-Sasa that the distribution 7r t (c,h) (or p s tat{c,h) for the standard Hatano-Sasa) is 
difficult to determine and may not be a smooth function [39]. Indeed, this distribution 
can be calculated analytically only in a few simple cases, such as in the case of discrete 
models involving only a few states or for a particle in an harmonic trap obeying overdamped 
Langevin dynamics as discussed in the previous section [36, 37]. For more complex systems, 
this distribution will not be accessible analytically. However if the system (or sub-system) of 
interest is of small size, the numerical determination of this distribution is possible through 
extensive simulations as we have shown on an example based on the Glauber-Ising model 
[16]. Among the various other strategies which can facilitate this numerical determination, 
one recent interesting suggestion is to determine the distribution iteratively by starting from 
an approximate ansatz function [39]. 

VI. CONCLUSION 

In this paper, we have first emphasized a particular point, namely that a detailed fluc- 
tuation theorem can be of strong or weak form depending on whether the initial and final 
probability distributions have a symmetry under protocol reversal. As we discussed in the 
case of the entropy production, this property means that the system stochastic entropy is or 
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not anti-symmetric with respect to protocol reversal. 

We have then presented a general framework for systems which are prepared in a non- 
stationary non-equilibrium state in the absence of any perturbation, and which are then 
further driven through the application of a time-dependent perturbation. Typically for ap- 
plications, this perturbation is applied as a means to probe the non-equilibrium properties of 
the unperturbed non-equilibrium state. We can formally distinguish two different situations 
depending on the way the non-equilibrium state is prepared. 

In the first category, the non-equilibrium state is created by some driving, and thus 
the perturbation which will be applied to it after some time should be viewed as a second 
driving. As a particular simple example of this category, one can create the initial state 
by a periodic driving. In these conditions, our approach predicts a modified second law of 
thermodynamics for transitions between periodically driven states. Such periodically driven 
states are achievable in a number of experimental systems such as vibrated granular medium, 
electronic circuits, manipulated colloidal systems, or quantum optics for instance. 

In the second category, the initial non-stationary state is a transient state produced by 
the choice of initial conditions. For instance, the system has been prepared by a quench of 
some parameter which can be the temperature or the concentration for instance, and the 
dynamics which follows involves relaxation or coarsening. This is typically what happens in 
a glassy system, where the slow relaxation following this quench leads to aging. 

For all these systems, the generalization of the second law of thermodynamics derived 
in this paper should hold. In this extension, the dissipated work which enters one form of 
the standard second law is replaced by the average of a new functional (y), which can be 
defined without reference to thermodynamics. We found that this quantity is related to 
the lag between the actual probability distribution and the 7r t distribution evaluated at the 
current value of the control parameter, in the same way as the dissipated work is related 
to the lag with respect to the equilibrium distribution. Furthermore, (y) approaches the 
adiabatic limit in a similar way as the dissipated work, i.e. in a manner which is proportional 
to the inverse of the duration of the driving. We hope that our work can contribute to 
the elaboration of a theoretical framework for modified fluctuation-dissipation theorem and 
modified second law, in particular for systems in contact with a non-equilibrium bath. 
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Appendix A: Definition of duality from current reversal 

In the main text, we have introduced four dynamics with generators L^*, and 
L t *. For all these dynamics, with a generator that we write generally to encompass all 
cases, we define a probability distribution pt{c) solution of the following master equation : 

^ = 5>(cOL^c). (Al) 

d 

In the same spirit, we have several reference probability distributions 7r t (c, h), 7ft(c, h), nt(c, h) 
and 7i t (c,h) associated to the generators L^L^L 1 ^ and L^, that we note generally n t (c,h) 
with generator L^. The corresponding general master equations is 

(7?) (c,h) = J2Mc',h)L}(c',c) = J2^ ht (c,c'), (A2) 
^ ' d d 

in which we have defined the reference probability current of the dynamics modified by the 
tilde transformation 

J t h (c, C') = 7T t (c, h)wfc, C') - TT t (c', h)w h t {c\ c). (A3) 

We want to show in this appendix that the dual dynamics corresponds to the dynamics for 
which accompanying probability currents in the system at time t are opposite to accompa- 
nying probability currents in the system with reversed dynamics at time T — t, that is to say 
[5, 40]: 

J t h *(c,c') = -j} T _?(c,c'). (A4) 

To do so, we start from this definition of duality and find back the dual rates of Eq. 23. First 
we remark that if all dynamics are connected, it is the same for the reference probability 
distributions. For instance, we can check that 7r T (c,h T ) = ttt- t {c, ^t-t) by verifying that 
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both quantities are the solution of the same differential equation 

(d t 7t t )(c',h t ) = J2Jt ht (c,c) = -Y,^M = ~ {d(T-t)*T-t) (c',hr-t) (A5) 

c c 

with the same initial condition 7f (c, ^o) — ttt(c, for)- Now, to obtain the dual rates, we use 
this symmetry vr T (c, h T ) = 7fy_ T (c, hx- T ) an d Eq A4 to get 

vr t (c, ht)w^{c, c') - 7r t (c', h t )w^(c', c) = - ^7r t (c, h t )w^Tt (c, c') - vr^c', h t )wT T St (c' , c) 

= 7t t (c', h t )w^(c', c) - vr t (c, /^'(c, c'). (A6) 

The simplest rates that verify this equality are 

^(c,c0 = ^4^#^- (A7) 

71V (C, 

The last step consists to use the fact that the duality obtained from Eq. A4 has to be an 
involution (whereas it was not trivial to see it on Eq 23) in such a way that w^(c,c') = 
w^(c, c'). We then end with Eq 23 as another definition of the duality transformation. Note 
that we have J7y^'(c, c') ^ Jt' t {c, c') because Tr t _ T (c, h t ^ T ) ^ 7r t (c, h) as we can check using 
Eq A2 so duality is not a trivial reversal of the current as it was in the stationary reference 
framework. 
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FIG. 1. Illustration of the detailed fluctuation relation obeyed by the quantity y. Orange squares 
correspond to a long protocol with fast relaxation of the nt function towards equilibrium (orange 
dashed line of the insets) whereas black dots are for a short protocol with slow relaxation towards 
equilibrium (black solid lines of the insets). Inset (i) shows the half sinusoidal protocols and inset 
(ii) shows the relaxation, as a function of time t, of the distribution irt(b,h) towards equilibrium 
distribution for a given h value. 



33 




FIG. 2. Illustration of the modified second law for non-stationary systems created by periodic 
driving. Symbols represent the driving entropy production (y) (filled squares), the non adiabatic 
entropy production (AS na ) (filled triangles), the difference of traffic (AT) (bullets) and (ASb) 
(stars) as function of the duration of the driving td- The solid line is simply 1/td and shows that 
(y) and (AS na ) behave as the inverse of the duration of the driving td in the limit of large td- 
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FIG. 3. Transition between non stationary oscillating states for different time of driving: (from 
left to right) = 50 and td = 7.91. Top: Protocol imposed in orange dashed lines and in black 
line the total force applied on the system. Bottom: Exact (black) and accompanying probability 
distribution (orange) of state b as a function of time. For the shortest protocol, we see that the 
accompanying distribution is different from the exact solution while the protocol is changing. 
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FIG. 4. Inset: Transitions between two non stationary states corresponding to the forces ht 



1.3 



and /it d/ . = 3. The spring constant is oscillating with a period of 0.5 around the value 1 and with 



an amplitude of 0.5. The inverse temperature is taken at f3 = 0.2, the friction is 7 = 1. 
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